Optimizing Parallel Applications for Wide-Area Clusters
نویسندگان
چکیده
Recent developments in networking technology cause a growing interest in connecting local-area clusters of workstations over wide-area links, creating multilevel clusters. Often, latency and bandwidth differences between local-area and wide-area network links are two orders of magnitude or more. With such a large difference, one would expect only very coarse grain applications to achieve good performance. Hence, most meta computing endeavors are targeted at job-level parallelism. To test this intuition, we have analyzed the behavior of several existing mediumgrain applications on a wide-area multicluster. We find that, if the programs are optimized to take the multilevel network structure into account, most obtain high performance. The optimizations we used reduce intercluster traffic and hide intercluster latency, and substantially improve performance on wide-area multiclusters. As a result, the range of applications suited for a meta computer is larger than previously assumed.
منابع مشابه
Parallel Computing on Wide-Area Clusters: the Albatross Project
Henri E. Bal Aske Plaat Thilo Kielmann Jason Maassen Rob van Nieuwpoort Ronald Veldema Department of Computer Science, Vrije Universiteit, Amsterdam, The Netherlands fbal,aske,kielmann,jason,rob,[email protected] http://www.cs.vu.nl/albatross/ Abstract The aim of the Albatross project is to study applications and programming environments for widearea cluster computers, which consist of multipl...
متن کاملWide-Area Parallel Computing in Java
Java’s support for parallel and distributed processing makes the language attractive for metacomputing applications, such as parallel applications that run on geographically distributed (wide-area) systems. To obtain actual experience with a Java-centric approach to metacomputing, we have built and used a high-performance widearea Java system, called Manta. Manta implements the Java RMI model u...
متن کاملThe Albatross Project: Parallel Application Support for Computational Grids
The aim of the Albatross project is to study applications and programming environments for computational grids consisting of multiple clusters that are connected by wide-area networks. Parallel processing on such systems is useful but challenging, given the large differences in latency and bandwidth between LANs and WANs. We provide efficient algorithms and programming environments that exploit...
متن کاملWide-area parallel programming using the remote method invocation model
Java’s support for parallel and distributed processing makes the language attractive for metacomputing applications, such as parallel applications that run on geographically distributed (wide-area) systems. To obtain actual experience with a Java-centric approach to metacomputing, we have built and used a high-performance wide-area Java system, called Manta. Manta implements the Java Remote Met...
متن کاملHOMME and POPperf High Performance Applications: Optimizations for Scale
The High Order Method Modeling Environment (HOMME) and the modified version of The Parallel Ocean Program (POPperf) are two important applications for atmospheric and weather research. With an emphasis on efficiency, portability, maintainability and most importantly, scalability, HOMME and POPperf have been successfully deployed over the years on a wide variety of highperformance systems, such ...
متن کامل